The Application of Sampling to the Design of Structural Analysis Web Crawlers
نویسنده
چکیده
The growth of the World Wide Web (WWW) has seen it evolve into a rich information resource. It is constantly traversed with the aid of crawlers so as to harvest web content. When collecting data, crawlers have the potential of causing service denial to web servers. This paper proposes the application of sampling as a selection strategy in the design of structural analysis web crawlers. This has the benefit of alleviating the problems of bandwidth costs to web servers whilst retaining the quality of the data that is mined by crawlers. The initial results of this study are promising and are presented in this paper.
منابع مشابه
A Comparative Study of Performance of Adaptive Web Sampling and General Inverse Adaptive Sampling in Estimating Olive Production in Iran
Nowadays, there is an increasing use of sampling methods in network and spatial populations. Although the most common link-tracing designs such as adaptive cluster sampling and snowball sampling have advantages over conventional sampling designs such as simple random sampling and cluster sampling, these designs still present many drawbacks. Adaptive web sampling is a new link-tracing design tha...
متن کاملdesigning and implementing a 3D indoor navigation web application
During the recent years, the need arises for indoor navigation systems for guidance of a client in natural hazards and fire, due to the fact that human settlements have been complicating. This research paper aims to design and implement a visual indoor navigation web application. The designed system processes CityGML data model automatically and then, extracts semantic, topologic and geometric...
متن کاملDesign and Analysis of Pressure Vessel Subjected to Pressure-temperature Variation (TECHNICAL NOTE)
Pressure vessel is a container used to store fluids under pressure and temperature. The fluids can be air, water, chemicals, fuel, gases etc. are most commonly used in food and chemical industries, oil refineries and so on. Pressure vessel is subjected to thermal and structural loads for power plant applications. Since the pressure vessel are subjected to both structural and thermal loads stres...
متن کاملMulti-objective Optimization of web profile of railway wheel using Bi-directional Evolutionary Structural Optimization
In this paper, multi-objective optimization of railway wheel web profile using bidirectional evolutionary structural optimization (BESO) algorithm is investigated. Using a finite element software, static analysis of the wheel based on a standard load case, and its modal analysis for finding the fundamental natural frequency is performed. The von Mises stress and critical frequency as the proble...
متن کاملA brief history of web crawlers
Web crawlers have a long and interesting history. Early web crawlers collected statistics about the web. In addition to collecting statistics about the web and indexing the applications for search engines, modern crawlers can be used to perform accessibility and vulnerability checks on the application. Quick expansion of the web, and the complexity added to web applications have made the proces...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010